Web Survey Bibliography
Title Dynamic Interviewing Program (DIP): Online- Interviews via ICQ
Author Stieger, S., Reips, U. -D.
Year 2005
Access date 22.04.2005
Abstract Automatic data collection in Instant Messaging as a means for conducting online research per interview is presented. Interviews are some of the most difficult and laborious procedures in online research, because this type of surveying presupposes synchronous communication. Up to now, Internet-based interviews were mainly conducted personally and one-to-one by the interviewer in the Internet Relay Chat (IRC) and in Multi-User Dungeons (MUDs). The obvious disadvantages of these procedures is the necessary presence of the interviewee in the channel or chat room and the limit of one interview at one time, leading to low number of particiants in Internet-based interview studies. To fill the gap, we developed DIP (Dynamic Interviewing Program) on top of a freely available instant messaging ICQ ("I seek you") client (vICQ). DIP allows automatic online interviewing via ICQ. While so-called agents have been used before for communication tasks (e.g. within AOL there are IM-bots that provide automatic information for its users, for example business news, weather, recipes, phone numbers, or even play games), DIP is the world's first automatic IM tool for surveying. In our presentation we will show (1) DIP's technical make-up (participant recruitment module, interview module, administration module) and (2) present the results of a study conducted with DIP. An interview request was sent to 541 randomly selected ICQ users. The response rate was 28.3%, with response definded as responding to the minimum of one question. Answers to demographical questions were validated by checking the publicly available ICQ user address book. Mean age of participants was M=21.8 years, early drop-outs had a mean age of M= 23.7 years and non-responders of M=23.4 years. 78.6% of participants reported to be male, versus only 64.9% among early drop-outs. Proportion of males for non-responders was in-between: 69.5%. In sync with earlier reports of limited false reports of demographical data in university-based Internet studies in the literature only 4.5% masked their gender (gender switching) and 8.1% their age. Possibilities and challenges in future use of DIP will be discussed.
Abstract - optional Wir stellen erstmals die automatisierte Datenerhebung im Instant Messaging zum Zwecke der Online-Forschung per Interview vor. Interviews gehören zu den schwierigsten und aufwändigsten Verfahren der Online-Forschung, da diese Art der Befragung eine synchrone Kommunikation voraussetzt. Bis dato wurden Interviews im Internet hauptsächlich im Internet Relay Chat (IRC) und in Multi-User-Dungeons (MUDs) durchgeführt - vom Interviewer persönlich in einer one-to-one Kommunikation. Dies hat die Nachteile, dass man zeitlich an die Anwesenheit der befragten Person in einem Channel oder Chatroom gebunden ist und zu einem Zeitpunkt immer nur ein Interview durchgeführt werden kann. Dies resultierte in einer - im Vergleich zu den sonst hohen Zugriffszahlen bei Internet-basierten Studien - geringen Fallzahl an Versuchspersonen. Um diesen Problemen von Aufwand und zeitlicher Abhängigkeit zu begegenen, wurde basierend auf einem frei im Internet verfügbaren ICQ-Client (vICQ) eine Interviewsoftware (Dynamic Interviewing Program - DIP) entwickelt. Diese Software ermöglicht die automatische Durchführung von Online-Interviews mittels des Instant Messaging - Programms ICQ. Während das Konzept, sogenannte Agenten über Instant Messaging - Programme kommunizieren zu lassen, an sich nicht neu ist (AOL beispielsweise hat einige Bots welche über den AOL Instant Messenger (AIM) Informationen für seine User bereitstellen - diese Bots spielen Spiele, geben Auskunft über Telefonnummern (Yellowpages), verbreiten Businessnews, liefern Kochrezepte und informieren über das Wetter), so ist DIP doch die weltweit erste Realisierung eines IM-Tools speziell für Befragungen. Hier soll einerseits die technische Realisierung von DIP vorgestellt werden (Teilnehmerrekrutierungsmodul, Befragungsmodul, Administrationsmodul), andererseits auch die Ergebnisse einer mit DIP durchgeführten Studie. Dabei wurden an 541 ICQ-User (randomisierte Auswahl) Teilnahmeaufrufe für ein Online-Interview gesandt. 28.3% reagierten auf diesen und beantworteten mindestens die erste Frage. Dieses Online-Interview erhob unter anderem demographische Daten, um diese dann mit den Angaben im ICQ-Useradressbuch zu vergleichen. Dabei zeigte sich, dass der Altersmittelwert der Teilnehmer M=21.8 Jahre war, jener die frühzeitig das Interview abbrachen M= 23.7 Jahre und jene die auf die Teilnahmeaufforderung nicht reagierten M=23.4 Jahre. Bezogen auf das Geschlecht waren bei den Teilnehmern 78.6% Männer, bei den frühzeitigen Abbrechern 64.9% und bei jenen welche nicht reagierten 69.5%. Durch den Vergleich mit den Online-Adressbuchdaten konnten auch Falschangaben ermittelt werden. Dabei maskierten im Einklang mit früheren Befunden lediglich 4.5% ihr Geschlecht (Gender-Switching) und 8.1% ihr Alter. Möglichkeiten für eine zukünftige Verwendung als auch Vor- und Nachteile werden diskutiert.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2005 (76)
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- Controlling the Baseline Speed of Respondents: An Empirical Evaluation of Data Treatment Methods of...; 2005; Mayerl, J.
- Determinanten der Rücklaufquote in Online-Panels; 2005; Batanic, B., Moser, K.
- On the cost-efficiency of probability sampling based mail surveys with a Web response option; 2005; Werner, P.
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- The total survey error approach. A guide to the new science of survey research; 2005; Weisberg, H. F.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Reading behavior in the digital environment: Changes in reading behavior over the past ten years; 2005; Liu, Z.
- Rating versus comparative trade-off measures. Trending changes in political issues across time and predictive...; 2005; Thomas, R. K., Behnke, S., Johnson, Al., Sanders, M.
- Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm; 2005; Dickersin, K.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- Drop-down boxes, radio buttons, or fill-in-the-blank? Web survey scale-type effects; 2005
- Does weighting for nonresponse increase the variance of survey means?; 2005; Little, R. J., Vartivarian, S.
- Big scale observations gathered with the help of client side paradata; 2005; Haraldsen, G., Kleven, O., Sundvoll, A.
- User Interface Design and Evaluation ; 2005; Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.